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Abstract 


Conventional control techniques do not sufficiently address the problem of control 
design for complex nonlinear systems. The field of intelligent control was developed 
for solving such problems by incorporating logic, reasoning and heuristics into the 
more algorithmic approach provided by conventional control theory. Fuzzy control 
and neural networks have become two important streams of intelligent control. 
Various approaches have been proposed in the literature to combine fuzzy and 
neural systems in order to utilize their synergetic relationship and to compliment 
each other thereby eliminating their respective drawbacks. This thesis attempts to 
evaluate the performance of a class of such neuro-fuzzy controllers. The fuzzy-neural 
system (ANFIS) studied here results on translating a fuzzy inference system into 
a connectionist network form. This controller is then applied to a simple linear 
system and two nonlinear control problems. In the first example ( speed control of 
a permanent magnet dc motor), the system attempts to track a specified speed 
trajectory. In the second example ( disturbance rejection in a buck-boost converter 
system ), the controller tries to make the average output voltage constant when some 
random disturbance is present in the input dc voltage. The simulation results reveal 
that the ANFIS controller performed well under certain specific conditions. For its 
general applicability to real control situations, more theoretical results are needed 
and some important problems are required to be addressed. 
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Chapter 1 
Introduction 


Many of the physical systems encountered in real world are nonlinear in nature. 
Their linearity property is exhibited only in a limited operating range i.e. when the 
physical system does not deviate too much from the nominal set of operating con- 
ditions. Hence appropriate theoretical tools are required for analysis and synthesis 
of such systems. Compared with the significant advances in linear control theory, 
the advances in nonlinear control have been limited. Universally applicable tools 
and methodologies are not available for such systems and so they have to be dealt 
on system by system basis. 

1.1 Past Developments 

The local linearization-based analysis is probably the most widely used analysis and 
design method for nonlinear control systems. The initial applications of this method 
involved calculating a linear dynamic model to approximate the nonlinear system at 
its nominal operating point. Mild nonlinearities could be tolerated, since as long as 
the system remained near this operating point, the feedback made system insensitive 
to small dynamic mismodclling. The obvious deficiency of this technique was that 
significant nonlinearities could not be tolerated, since the linear approximation 
would be valid only in a small neighbourhood of the nominal operating point. 

This simple linear control technique was extended to systems with multiple 
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significant nonlinearities using gain scheduling. In gain scheduling, the nonlinear 
system is approximated by performing multiple local linearizations about a variety of 
trajectones. Once this collection of linear models is established, a linear controller is 
designed for each of these linear models, and then these controllers are interpolated 
as the system moves from one trajectory neighbourhood to another. Again this 
allows the use of linear control design and analysis tools but requires the use of 
enough approximate linear models to capture the nonlinear dynamics of the plant 
adequately. In general, the neighbourhood where the approximation is valid may be 
small, thus requiring a large number of approximate linear models to characterize 
adequately the nonlinear system truly in its useful operating range. The above 
requires a lot of effort on the part of control system designer. 

The gam scheduling technique essentially approximates the nonlinear system 
with a time vaiying linear model. The approximation of nonlinear system with a 
linear time- varying model inspired the application of adaptive control. In adaptive 
control, realtime measurements of the plant inputs and outputs are used either to 
derive explicitly a model for the plant and then design a controller based on this 
model (indirect adaptive control) or to directly modify the controller (direct adaptive 
control). Although the principle behind adaptive control is straight forward, the 
analysis of adaptive control is complicated by the nonlinear and time varying nature 
of the system. Another thing observed was that the interaction of disturbances 
and external command signals with even slight mismodelling could lead to severe 
instability (Rohrs et al. 1980). The reason for this kind of behaviour was that the 
initial theory did not adequately account for all of the non-ideal conditions present 
in the realistic control environment. 

The current practice of adaptive control comprises the identification of specific 
parameters. For indirect adaptive control a set of plant parameters is identified, 
while for direct adaptive control it is a set of controller parameters that is identified. 
For linear (possible time- varying) plants these parameters are frequently the transfer 
function coefficients although if there is adequate a priori information, physical 
parameters of the plant or explicit gain in the controller may be identified. The 
most successful applications of adaptive control are those in which there is enough 
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a priori information to reduce the number of identified parameters to a manageable 
set and thereby decrease the computation time substantially. Also important in 
adaptive control is the fundamental conflict of regulation and identification. For 
good parameter identification, signals with rich frequency content are desired so 
that all of the significant dynamics of the system will be identified. However, this is 
in direct conflict with the goal of regulation. Under good regulation the system is 
relatively quiescent and the input and output signals will not adequately excite the 
system, making identification difficult. In control practice this has led to various 
schemes that turn off the identification when regulation is good, and thus performing 
both the operations satisfactorily. 

Other practical methods for nonlinear control are also available in the literature, 
but mostly these are applicable to specific systems which are quite simple in nature. 

1.2 Intelligent Control 

To circumvent the problems mentioned above and to realise more flexible control 
systems a field of intelligent control was developed which incorporated elements such 
as logic, reasoning and heuristics into the more algorithmic techniques piovided by 
conventional control theory. 

Intelligent control systems reflect the ability to emulate human capabilities, such 
as planning learning and adaptation Such systems tackle the problem of environ- 
mental uncertainty by human-like decision making, heuristic reasoning and learning 
from past experience. Learning is required when the complexity of a problem or 
the uncertainty thereof prevents a prion specification of a satisfactory solution. 
Such solutions are then only possible through accumulating information about the 
problem and using this information to dynamically generate an acceptable solution. 
Such systems are required to exhibit satisfactory closed loop system performance 
and integrity over a wide range of operating conditions. The characteristic of the 
system must therefore relate to the complexity of the plant, including nonlinear and 
time variant plant behaviour, dimensionality and other multivariable characteristics, 
the complexity of the desired performance objective, imperfection and uncertainties 
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in the measurements, and an ability to cope with component failures. 

In recent years the use of the terminology intelligent control has come to em- 
brace diverse methodologies combining conventional control theory and emergent 
techniques based on physiological metaphors, such as neural networks, fuzzy logic, 
artificial intelligence, genetic algorithms and a variety of search and optimisation 
techniques Amongst these, fuzzy logic and neural network techniques have acquired 
important positions. 

1.2.1 Fuzzy Control 

One of the most widely publicised techniques for embodying human-like thinking 
into a control system is fuzzy control [1]. A fuzzy controller can be designed to 
roughly emulate the human deductive process. A typical fuzzy controller, as shown 
in Figure 1.1 consists of four main components: a rule base, a fuzzy inference system, 
an input fuzzification interface, and an output de-fuzzification interface. The rule 
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Figure 1.1: Fuzzy Controller 


base holds a set of IF - THEN rules that quantify the knowledge that human 
experts have amassed about solving particular problems. It acts as a resource to the 
fuzzy inference system, which makes successive decisions about which rules are most 
relevant to the current situation and applies the actions indicated by those rules. 
The input fuzzifier takes the crisp numeric inputs to the system and, as its name 
implies, converts them into fuzzy form needed by the fuzzy inference system. At 
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the output, the de-fuzzification inteiface combines the conclusions reached by the 
fuzzy inference system and converts them into crisp numeric values as an output. A 
typical fuzzy control rule can be of the following type: 

IF e(t) is positive-small AND e(t) is positive-medium, 

THEN u(t) is positive-small. 

where e(t) and e(t) are error (desired output - actual output) and derivative of error 
respectively, and u(t) is the control force. Positive-small and positive-medium are 
classes into which the crisp input values are put by the fuzzification interface. A 
complete rule base consists of a whole set of such rules in which linguistic descriptions 
like positive medium etc. are given precise meaning by fuzzy logic. Different models 
of fuzzy reasoning mechanisms have been developed in the literature, some of which 
will be described in Chapter 2. 

Fuzzy logic control (FLC) has proven effective for complex and imprecisely 
defined piocesses for which standard model based control techniques arc difficult 
to apply. There are, however, a number of problems associated with FLC design. 
A common bottleneck is that the derivation of fuzzy control rules is often time 
consuming and difficult and relies to a great extent on so called process experts 
who may not be able to transcribe their knowledge into the requisite rule form. 
There also exists no formal framework for the choice of parameters of fuzzy systems 
and hence the means of tuning them, and learning models in general has become an 
important subject in fuzzy control. Problems with high dimensionality arc also often 
encountered in implementation of fuzzy control systems for multivariable processes, 
since the number of rules increase rapidly for multiple input systems. Such problems 
have generated considerable scepticism about what fuzzy control can or cannot 
achieve, fuelled not least by an absence of fuzzy theoretic formalism. The most 
common issues of criticism arise from the fact that fuzzy design is still generally a 
heuristic methodology for which no analytical tools exist to verify or validate the 
controller performance or stability. Piesently however, a number of studies related 
to analytical issues in fuzzy systems, such as fuzzy modelling and stability analysis, 
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are being undertaken [2], [3] 


1.2.2 Neural Networks for Control 

Next to fuzzy logic systems, probably no other intelligent control area has stirred as 
much interest as the application of artificial neural networks (ANN) for control [4]. 
The basic design principles used in neural network control (NNC) are not entirely' 
unique to neural network design, but can be viewed as a subset and extension of 
well known principles from control theory such as dynamic programming. 

Neural computation represents a technique by which knowledge is acquired from 
sets of training examples and stored in a distributed manner in connectionist struc- 
ture of the network. The distnbutivity contributes to increased learning capabilities 
of neural networks because the individual elements in the network are capable of 
adjusting their connections to achieve near optimal input-output mappings. Also 
distributive learning permits a response to a novel situation which is inferred using 
knowledge of previously learned, similar but not exactly same, circumstances. Thus 
the major advantage of neural network learning is the ability to accomodate poorly 
modelled, nonlinear dynamical systems. 

Neural networks can be classified into two main categories based on their connec- 
tion structures' feedforward and recurrent [5] (see Figure 1.2). Recurrent (feedback) 
networks are more suitable for control of dynamical systems, where current outputs 
depend on past inputs and outputs. The output of a feedforward network is a 
function only of its current inputs and hence cannot truly model dynamic behaviour. 
But feedforward network are the most commonly used type, mainly because of 
difficulty of training and stability in feedback networks. Feedforword networks 
have been successfully applied in identification and control of dynamic systems by 
explicitly using the required number of past inputs and outputs in the training 
procedure [6], [7]. 

Various approaches of neural network application to control problems are avail- 
able in the literature. Some of major methods include: 

1. Supervised control [18]. 
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Figure 1.2: Feedforward and Recurrent networks 


2. Direct inverse control [20]. 

3. Direct adaptive control [20]. 

4. Indirect adaptive control [23], [24]. 

5. Model reference control [18]. 

These methods will be discussed in detail in Chapter 3. The drawback of neural 
systems is the difficulty in interpreting the knowledge stored m the network. The 
distributed nature of such systems does not provide a strong scheme of knowledge 
representation. To overcome this hurdle methods have been proposed to integrate 
fuzzy logic with neural networks and this resulted in the development of Fuzzy- 
Neural Systems. 


1.2.3 Synthesis of Fuzzy and Neural Systems 

Fuzzy logic and neural systems have contrasting control application requirements. 
On one hand, fuzzy control systems are appropriate if sufficient expert knowledge 
about the process is available, while on the other, neural systems are useful if 
sufficient process data is available or measurable. Despite this there exists a lot 
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lot of similarity and a synetgetic relationship between neural networks and fuzzy 
logic systems [8]. Formal equivalences between different types of fuzzy and neural 
systems have also been established [9], and it has been shown that neural networks 
can be constructed that are identical to fuzzy logic controllers [10]. Both approaches 
build nonlinear systems based on bounded continuous variables, the difference being 
that neural systems are treated in a numeric (quantitative) manner whereas, fuzzy 
systems are treated in a symbolic (qualitative) manner. By combining the two things 
we can use the strength of each one in reinforcement of the other in the resulting 
fuzzy-neural system In particular, neural networks do not provide a strong scheme 
for knowledge representation while fuzzy logic controllers, in their basic form at least, 
do not have capabilities of automated learning. A fuzzy-neural system would posses 
a representational scheme that can portrait knowledge in an explicit manner by 
providing excellent reasoning interface and understandable model structure having 
both knowledge acquisition and learning capability. 

1.3 Objective and Organisation of the Thesis 

The objective of this thesis is to evaluate the performance of a class of neuro-fuzzy 
controllers These controllers are derived based on a fuzzy-neural system known as 
Adaptive Network Based Fuzzy Inference System (ANFIS). Chapter 2 of the thesis 
describes ANFIS architecture and its learning algorithm Chapter 3 discusses various 
control structures that can be derived using ANFIS. In this chapter the performance 
of this class of controllers is observed using a simple linear model. To investigate 
further, two case studies are presented in Chapters 4 and 5. In Chapter 4, the 
results of this controller, when used for the speed regulation of a permanent magnet 
dc motor are presented, while those for the disturbance rejection in a buck-boost 
converter system are presented in Chapter 5. The thesis concludes with suggestions 
for further work in Chapter 6. 
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Chapter 2 

Adaptive Network based Fuzzy 
Inference System (ANFIS) 


Fuzzy and neural systems have been integrated at different levels and in various ways 
to give several fuzzy-neural paradigms, yet two distinctive approaches of synthesis 
can be identified. On one hand, many paradigms use multilayered feedforward 
neural networks to approximate a fuzzy control algorithm [11]. On the other, there 
are approaches which translate a fuzzy inference system to a connectionist network 
form and then tune the parameters of the fuzzy system [12]. The fuzzy-neural system 
used here (ANFIS) belongs to the latter class. It converts a fuzzy model, properly 
known as the Sugeno fuzzy model [13], into a network form and tunes parameters 
of the model for near optimal input output mappings. 

2.1 Fuzzy Inference System 

As indicated earlier a fuzzy controller has four main components: a rule base, a 
fuzzy inference system, an input fuzzification interface and an output defuzzification 
interface Sometimes the rule base is considered as a part of fuzzy inference system. 
The decision making logic in the fuzzy logic controller is handled by the fuzzy 
inference system and hence it is also known as the kernel of fuzzy controller. It 
makes the choice of rule to be fired from the rule base m the current input conditions. 
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Fuzzy inference system is based on the concepts of fuzzy set theory, fuzzy if-then 
rules and fuzzy reasoning. Thus for understanding its functionality some concepts 
of fuzzy if-then rules and fuzzy reasoning will have to be reviewed. 

2.1.1 Fuzzy If-Then rules 

A fuzzy if-then rule (fuzzy implication or fuzzy conditional statement) takes the 
following form: 

if a; is A then y is B (also written as A — » B) 

where x and y are fuzzy variables and A and B are linguistic values defined by fuzzy 
sets and can be written as: 


A — {(x, Ha{T)) | x G X} and 

B = {(y,fi B (y)) | V € Y} 


where X and Y are universe of discourses and /i A ( x ) and ^(y) are associated 
membership functions (MFs). A realistic example of a fuzzy rule is: 

if pressure is high then volume is small 

here pressure and volume are fuzzy variables and high and small are defined by 
appropriate fuzzy sets formed by associating a membership function to the fuzzy 
variables. The fuzzy rule above, in essence, describes a relation between two fuzzy 
variables x and y, and can be defined as a binary fuzzy relation R on the product 
space X x Y. Alternatively a binary fuzzy relation can be viewed as a fuzzy set 
with universe Ixh, characterised by a two dimensional MF /j,n(x,y ). 
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2.1.2 Fuzzy Reasoning 


Fuzzy reasoning (also known as approximate reasoning) is an inference procedure 
used to derive conclusions from a set of fuzzy if-then rules and one or more condi- 
tions. The fuzzy reasoning mechanism can be illustrated with the help of following 
example: 

Let x and y be two fuzzy variables and A, A' & B : B' linguistic values (fuzzy 
sets) on X , X, Y and Y respectively. Using the truth of proposition A and fuzzy 
relation A -> B on X x Y we can infer the truth of proposition B as follows: 

premise 1 (fact) : x is A' , 

premise 2 (rule) : if x is A then y is B , 

consequence (conclusion) : y is B' . 

For instance if we have the implication rule if tomato is red then it is ripe (A B) 
and we know that the tomato is more or less red (x is A' ) then we may infer that 
the tomato is more or less ripe (y is B' ). This inference procedure is known as 

generalized modus ponens. Here the fuzzy set B' can be formed by using sup-star 

compositional rule of inference [14] and is given by: 

p B '{y) = max x min[p A '(x),p R {x,y)] 

= V* [p A - (x) A p R {x, y)] (2 1) 


where V indicates union and A intersection. In the above equation we have used max- 
min composition, we can also use max-product composition i.e. replace intersection 
with algebraic product, Equivalently, 

B' = A' o R = Ao(A^B) (2.2) 


equation (2 1) can be further simplified as [14] 
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Mb' (y) = v * [Ma' ( x ) A {ma(z) a Hb(v)}] 

= [V* {Ma' (*) A Ma (®) }] A \i B (y) 

= WA Mfl(y) (2-3) 

here tu is known as firing strength of the fuzzy rule A -4 B. Thus w is found as 
maximum of fi A > (x) A Ha{x) , shown in Figure 2.1; where the MF of resulting B' is 
equal to MF of B clipped at w, shown as shaded area in the consequent part of 
Figure 2.1 


min 



Figure 2.1. Fuzzy reasoning for a single rule with a single antecedent 


In the above example we had single rule with only one antecedent (premise 
variable). We can also have multiple rules with multiple antecedents and they can 
be analysed in the same fashion 

2.2 Different Fuzzy Inference Models 

After going through the basic fuzzy reasoning mechanism we can now discuss some 
of the fuzzy inference models proposed in literature. 
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2.2.1 Mamdani’s Fuzzy Model 

Mamdani’s fuzzy model [15] was initially used to control a steam engine and boiler 
combination by obtaining a set of control rules from experienced human operators. 
This model can be illustrated by the following example having two rules and each 
rule consisting of two antecedents (premise variables). 

premise 1 (fact) : a: is A' and y is B' , 

premise 2 (rule 1) : if x is Ai and y is B\ then z is C\, 

premise 3 (rule 2) : if x is A 2 and y is B^ then z is C 2 , 

consequence (conclusion) : z is C' 

To obtain the fuzzy set C' , let Ri = A\ x B\ — > C\ and R 2 = A 2 x B 2 -» C 2 . Then 

d = (A' x B') O (R x U R 2 ) (2.4) 

Since o operator is distributive over U, we have 

d = [(A' X B') O R t ] U [(A' x B‘) O R 2 ] 

= Clue; (2.5) 

where C\ & C 2 are given by [14] 

C[ = w\ A w 2 A fj, Cl (z) 

C 2 = w 3 A W4 A /j C2 (2) 

and 

^ 1,3 = V x [n A '{x) Aix Al , 2 { x )] 

W2A = ^y[^B'(y) A ^B h2 (y)} 

This reasoning procedure is shown in Figure 2.2 using max and min operators in 
place of fuzzy AND & OR. The crisp output can be found by defuzzifying the fuzzy 
set d . Various defuzzification strategies such as centroid of area, bisector of area, 
mean of maximum etc. can be employed for this purpose. 
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2.2.2 Sugeno Fuzzy Model 

This reasoning mechanism was proposed by Takagi and Sugeno [13], in order to 
develop a fuzzy model of a system using input-output data set. Rules of the following 
form are used in this model 

if x is A and y is B then z — f(x, y) 

where A & B are fuzzy sets in the antecedent and' z = f(x,y) is a crisp function in 
the consequent. Here the partitioning of the input space is done by the antecedent 
and the output in the resulting regions is defined by the function /. Usually f(x,y ) 
is taken as a linear function in x & y, but it can be any function as long as it can 
appropriately describe the output of the system within the fuzzy region specified by 
the antecedent of the rule. When f(x , y) is a first order polynomial, the resulting 
fuzzy system is called as first-order Sugeno fuzzy model. When / is a constant, we 
then have a zero-order Sugeno fuzzy model, which can be viewed as a special case 
of Mamdani’s fuzzy inference system, in which each rule’s consequent is specified by 
a fuzzy singleton (or a pre-defuzzified consequent). Also, a zero order Sugeno fuzzy 
model is functionally equivalent to a radial basis function network under certain 
minor constraints [9]. Figure 2.3 shows the fuzzy reasoning procedure for a first- 
order Sugeno fuzzy model. Since each rule has a crisp output, the overall output is 
obtained via weighted average and thus the time consuming process of defuzzification 
is avoided. 

2.2.3 Tsukamoto Fuzzy Model 

In the Tsukamoto fuzzy model [16], the consequent of each fuzzy if-then rule is 
represented by a fuzzy set with a monotonical MF, as shown in Figure 2.4. As a 
result, the inferred output of each rule is defined as a crisp value induced by the 
rule’s firing strength. The overall output is taken as the weighted average of each 
rule’s output. Figure 2.4 illustrates the whole reasoning procedure for a two input, 
two rule system. 
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min or product 






z = 


Figure 2.4: Tsukamoto fuzzy inference system 


2.3 ANFIS Architecture 

The Sugeno fuzzy model discussed above is the inference system which is used to 
form the adaptive network (ANFIS) [17]. For understanding the structure of ANFIS 
we take the following example having four Sugeno fuzzy rules, each rule comprising 
of two antecedents and one consequent linear function. The rules are expressed as : 


rule 1 : if x is A\ and y is B\ then fi = pix + q\y + r x . 

rule 2 : if x is A\ and y is B 2 then f 2 = p 2 x + q 2 y + r 2 . 

rule 3 : if x is A 2 and y is B\ then / 3 = p^x -F q$y + r 3 . 

rule 4 : if x is A 2 and y is B 2 then / 4 = p^x + q^y + r 4 . 

where each input is associated with two linguistic labels (fuzzy sets). Figure 2.5(a) 
illustrates the reasoning mechanism for this Sugeno model. The corresponding 
equivalent ANFIS architecture is shown in Figure 2.5(b). The antecedent part of 
these four rules partitions the input space into four regions as shown in Figure 2.6, 
and the output in each region is determined by the consequent part (/ x to / 4 ). 

The network, which is of feedforward type, consists of five layers, each layer 
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Figure 2.6' Partitioning of input space by the rules in Sugeno fuzzy model 


having several nodes. The nodes of preceeding layer are connected to those in the 
next layer through directional links. There are no links between the nodes of the 
same layer. Adaptive (modifiable) nodes are shown by squares, while the fixed 
ones are indicated by circles. Each node is a processing unit that performs a static 
node function on the incoming signal to generate a single node output and each 
link specifies the direction of signal flow from one node to another. No weights are 
associated with the links. Nodes of the same layer performs similar function on the 
incoming signals. Node function in the adaptive node is a parameterized function 
with modifiable parameters; by changing these parameters, we are actually changing 
the node function as well as the overall behaviour of the adaptive network. 

The specific description of each layer and its function is given below (we denote 
the output of node i in layer l as Oi tl ). 

layer 1 : This is also called as the fuzzification layer. Crisp values of the input 
variables are taken as inputs and the nodes give fuzzy values as outputs. Every node 
i is an adaptive node with a node output defined by 
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01.1 = AM, (a 0 , 

01.1 = 


for t = 1,2 & 

for ? = 3,4 


where a;, y are the inputs to the nodes and A l: J3j_ 2 are fuzzy sets associated with 
the nodes. In other words, outputs of this layer are the membership values of the 
premise part. Here the membership functions for A t and B t are the generalized bell 
functions of the form: 



where {a,, b t , c,} is the parameter set of a particular node i. Parameters in this 
layer are referred to as premise parameters. The number of membership functions 
per input variable indicates the number of categories into which the input variable 
is divided or fuzzified by this layer. In this example here, the input variable x is 
divided into two linguistic labels A\ and A 2 (see Figure 2.5(b)) having associated 
MFs fi Al (x) &; Ha 2 {x) respectively. 

layer 2 : Every node in this layei is a fixed (non-modiliable) node labeled II, 
which multiplies the incoming signals and outputs the product. The antecedent 
part (if part) of rules of the inference system are formed in this layer or in other 
words, nodes in this layer compute the firing strengths of different rules in the fuzzy 
reasoning mechanism. The outputs in this layer (as shown in Figure 2.5(b)) are 
given by 


02,1 

02,2 

02.3 

02.4 


Wi = fi Al (®) X A*Bj (y) 
U1 2 = AMi(s) X t- L B 2 (y) 

w>3 = /Ma0*0 X Uliiiv) 
Wa = A Ma(*) X (J.B 2 (y) 
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To illustrate the rule formation we can see that the antecedent part of rule 1 of 
the model described above (i.e. if x is A x and y is B x ) is formed by node 1, using 
product for fuzzy AND operator. Antecedents of other three rules is also formed in 
the same fashion by subsequent nodes in the layer. 

layer 3 : Every node in this layer is a fixed node labeled N. The nodes in this 
layer compute the normalized firing strengths of each rule i.e. the zth node calculates 
the ratio of the ith rule’s firing strength to the sum of all other rule’s firing strength. 


O z ,i = w l 


Wi 

E’«. 


layer 4 '■ Nodes in this layer are modifiable nodes with the following node 
function: 


Oi,i = Wifi — w l (p l x T q%y T Tj) , i = 1 to 4 

where wl is the output of layer 3 and {p t , q t , r^} is the parameter set of node i. The 
consequent part ( then part) of the rule is formed in this layer, hence the parameters 
{p u q t , fj} are referred to as consequent parameters. 

layer 5 : The single node in this layer is a fixed node labeled £, which calculates 
the overall ANFIS output as the summation of all incoming signals: 

0$,i = ^>2 wifi 


he /unctioning of the consequent part of the network can be explained as follows: 
^ 1 -gets fired i e. its normalized firing strength (uJl) is close to unity, then the 
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component wifi will dominate all other parts in the final network output /. Hence 
the output of the network will be defined largely by f\ = piX + qxy + rj. 

Clearly the network described above functions in the same way as first order 
Sugeno fuzzy model. Note that the fuzzification part is also taken care by ANFIS 
and since Sugeno fuzzy model gives crisp output, no defuzzification is required here. 

2.4 ANFIS Learning Algorithm 

Layer 1 and layer 4 in the network contain nodes which are modifiable, having their 
own (local) parameter set. A union of all the parameters of such nodes forms the 
network’s overall parameter set which controls the static mapping formed by the 
network. Desired nonlinear mapping can be obtained by tuning the parameters 
using a training data set consisting of a number qf desired input-output pairs of a 
target system. This tuning procedure is also known as network learning. In the 
coming part we will discuss two learning algorithms: gradient descent learning and 
hybrid learning [17]. 

2.4.1 Gradient Descent Learning 

The gradient descent learning algorithm, more commonly known as the back prop- 
agation algorithm, is the most well known and widely used training method among 
the current types of feedforward adaptive networks available. The central part of 
this learning rule concerns how to recursively obtain a gradient vector in which each 
element is defined as the derivative of an error measure with respect to a parameter. 
This is done by means of a chain rule and the gradient vector is calculated by 
propagating the errors in the direction opposite to the flow of output of each node. 
Details of the algorithm are described below. 

Suppose the given adaptive network has l layers and the kth layer has #(k) 
nodes. We denote the output and node function of ith node in kth layer by ff and 
Of respectively. This output Of depends on the incoming signals to the node and 
its parameter set. So we have: 
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of = ft ( Of-' , . . . 0^_ 1} , of, ftf — ) 


(2.8) 


where a*, 6^ etc are the parameters of the node. Assuming that given data set has P 
entries we can define an error measure (or energy function) for the pth (1 < p < P) 
entry of training data set as the sum of squared errors 

m 

E r = E (T m ,p - (2.9) 

771=1 


where T miP is the mth component of pth target output vector, and O l mp is the mth 
component of actual output vector produced by presenting pth input vector to the 
network. Thus the overall error measure is given by: 

p 

E = Y, E p (2.10) 

p = i 


For developing a learning procedure that implements gradient descent in E over 
the parameter space, we will have to calculate the error rate dE v /dO for pth training 
data sample and for each node output 0. The error rate for the ith node in the 
output layer l can be calculated using 


dE p 

30‘ hr 


- 2 (T„„ - O'J 


( 2 . 11 ) 


For the internal node % in layer k, the error rate can be derived using the chain rule: 

dE r # S£t 1) dE r eo*j 
30£p sot i 1 sol 


where 1 < k < l — 1. That is, the error rate of an internal node can be expressed 
as a linear combination of the error rates of the nodes in the next layer. Therefore 
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for all the nodes in the network i.e. for 1 < k < l and 1 < i < #(&), we can find 
dE p /d0^ p using equations (2.14) and (2.15). 

Now if a is a parameter of the given adaptive network, we have 


dE p _ ^ dE p dO* 
da 0 “s dO* da 


where S is the set of nodes whose output depends on a. Then the derivative of the 
overall error measure E with respect to a is 


OE _ * dEp 

da da 


(2.14) 


Accordingly, the update formula for the generic parameter a is given by 


Aa = —77 


dE_ 

da 


(2.15) 


in which 77 is called as the learning rate which can be further expressed as 

(2.16) 

where k is the step-size which determines the length of each gradient transition in 
the parameter space. Usually, we can change the value of k to vary the speed of 
convergence. 

Here we can have two learning paradigms depending on whether we update the 
network parameters based on E or E p . If we change the parameter a based on E 
using equation (2.17) then it is called as batch learning (or off-line learning). In 
this the update action takes place only after the whole training data set has been 
presented, i.e., only after each epoch or sweep. On the other hand, if we want 
the parameters to be updated immediately after each input-output pair has been 
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presented, then the update formula is based on E p using equation (2.16) and it is 
referred to as pattern learning (or on-line learning). 

2.4.2 Hybrid Learning Rule 

Although we can apply the gradient method to identify the parameters in the 
adaptive network, the method is generally slow and likely to become trapped in local 
minima. Here we discuss a hybrid learning rule [17] which combines the gradient 
method described above and the least squares estimation (LSE) technique to identify 
the network parameters 

For simplicity, let us assume that the adaptive network has only one output, 
which is given by: 


output = F(I,S ) 


(2.17) 


-4 

where I is the set of input variables and S is the set of parameters. If there exists a 
function H such that the composite function H o F is linear in some elements of S , 
then these elements can be identified by the least squares method. More formally, 
if the parameter set S can be decomposed into two sets 


S = Si® s 2 


(2.18) 


(where ® represents direct sum) such that H o F is linear in elements of S 2 , then 
on applying H to equation (2.17), we have 

H {output) = H o F{I, S) (2.19) 


which is linear in elements of S 2 . Now given the values of elements of Si, we can 
plug P training data into (2.19) and obtain a matrix equation: 
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AX = B 


( 2 . 20 ) 


where A' is an unknown vector whose entries are elements of 5 2 - If there are M 
elements in S 2 , then the dimensions of A, X and B are P x M, M x 1 and P x 1 
respectively. Since P (number of training data pairs) is usually greater than M 
(number of linear parameters), this is an overdetermined problem and generally 
there is no exact solution to (2.20). Instead, a least squares estimate (LSE) of X, 
X* is sought to minimize the squared error || AX — B || 2 . This is a standard problem 
and most well known formula for X* uses the pseudo inverse of X: 


X* = (A t A)~ 1 A t B 


( 2 . 21 ) 


where A T is the transpose of A, and ( A T A)~ 1 A T is the pseudo inverse of A if A r A 
is non-singular. The above formula is expensive in computation when dealing with 
the matrix inverse and, moreover, it becomes ill-defined if A T A is singular. To avoid 
this, we employ iterative formulas to compute the LSE of X. Specifically, let the 
rth row vector of matrix A defined in (2.20) be aj and the 2th element of B be bj, 
then X can be calculated iteratively by using the following sequential formulas: 


Ah+i 


a 


z+l 


X, + C, +1 a 1+1 ((f +1 - a[ +l X,) 


C, 


1 -f- j 0,0,4. i 


2 = 0 , 1 , ...,P-1 


( 2 . 22 ) 


where C t is called as the covariance matrix and the least square estimate X* is equal 
to A p. The initial conditions to bootstrap (2.22) are C 0 = 7/ and X 0 = 0 , where 7 
is a large positive number and I is the identity matrix of dimension M x M. 

In the network ANFIS the parameter set Si corresponds to premise parameters 
(parameters in layer 1) and parameter set S 2 corresponds to the linear consequent 
parameters (parameters in layer 4 ). We can combine the gradient descent method 
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and LSE to update the premise and consequent parameters in ANFIS. Each epoch 
of this hybrid learning procedure is composed of a forward and a backward pass. In 
the forward pass, we give input data and the functional signals propagate forward to 
calculate each node output until the matrices A and B in (2.20) are obtained, and 
the parameters in S 2 are identified by sequential least squares formulas in (2.22). 
After identifying parameters in £ 2 , the functional signals keep going forward till the 
error measure is calculated. In the backward pass, the error rates (the derivative of 
error measure w.r t each node output given by (2.11) and (2.12)) propagate from 
the output end towards the input end, and the parameters in S\ are updated by the 
gradient descent method using (2.15). For given fixed values of parameters in Si, 
the parameters in S 2 thus identified are optimum in the S 2 parameter space due to 
the choice of squared error measure. The hybrid learning rule described decreases 
the dimension of search space and cuts down the convergence time. 

Here also we can have two learning paradigms: the batch (off-line) learning and 
pattern (on-lme) learning. For batch learning gradient descent should be based of 
E (see (2.14)) and for pattern learning equation (2.13) using Ep is applied. 

2.5 Practical Considerations While Using ANFIS 

In a conventional fuzzy inference system, the number of rules in the rule base are 
decided by the experts familiar with the system to be modeled. While using ANFIS, 
this information, if available, can be incorporated in the network structure, otherwise 
the number of MFs assigned to each input (which determines the number of rules) 
are chosen by trial and error. This situation is much the same as that in neural 
networks: the number of nodes in hidden layers is decided by using certain rule of 
thumb. After the number of MFs associated with each input is fixed, the initial 
values of premise parameters are set in such a way that the MFs are equally spaced 
along the operating range of each input variable [17]. 

The step-size k which occurs in (2.16) influences the speed of convergence of the 
learning algorithm. If k is small, the gradient method will closely approximate the 
gradient path, but the convergence will be slow. On the other side, if k is large, 
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convergence will initially be very fast, but the algorithm will oscillate about the 
optimum. We can vary k adaptively to give improved performance. 
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Chapter 3 


Control Applications Using 
ANFIS 


The area of nonlinear control systems forms a potential field for application of the 
adaptive network introduced in Chapter 2. A number of approaches for the control 
of nonlinear dynamical systems using neural networks are available in the literature. 
We can utilise these techniques in designing a controller for such systems using 
ANFIS. This chapter introduces common design methods for ANFIS controllers 
which are mostly derived by directly replacing neural networks with ANFIS. 

3.1 Different Control Structures Using ANFIS 

A typical feedback control system (shown in Figure 3.1) consists of a plant and a 
controller. The plant is usually represented by a set of differential (or difference) 
equations which describe the dynamics of the physical system to be controlled. 
The plant’s response is indicated by the state vector x(k), which is assumed to be 
accessible in our discussion. In contrast, the controller is usually a static function g 
which maps the plant state and desired output x(k), x d (k) into a control action u(k) 
so that the combined system achieves a given control objective. Thus for a general 
feedback control system in discrete time domain, we have: 
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Figure 3.1: Block diagram for discrete time feedback control system 


x(k + 1) = f[x(k),u(k )] plant 

u(k) = g[x(k),Xd(k)] controller 

A central problem in control engineering is that of finding the control action u 
as a function of plant state x in order to achieve a given control goal. Different 
design methods exist for solving the above mentioned problem and some important 
techniques are as explained below. 

3.1.1 Supervised Control 

Supervised control [18] involves training of the adaptive network under supervision 
of an external agency, which can be a human operator or an expert. This is shown in 
Figure 3.2. Sometimes a conventional controller is also used for training the network, 
as shown in Figure 3.3 in which a PI(D) controller provides the required training 
data. In this method (also known as feedback error learning [19]), the performance 
of ANFIS controller is limited by the original controller. This approach is only 
advantageous in situations where the original controller is computationally more 
expensive, which occurs in systems with fast dynamics. 

3.1:2 Direct Inverse Control 

In direct inverse control (also known as generalized learning ) the adaptive network 
is trained to learn the inverse dynamics of the given plant [20]. Then in the actual 
control phase the network is connected as controller in cascade with the plant. This 
approach can be explained with the help of Figure 3.4. For a single input single 
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Figure 3.2: Supervised control 



Figure 3.3: Feedback error learning 
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output (SISO) plant, the training dataset is obtained by generating u(k ) at random 
and observing the states and output x(k ) and t/(A; + l) = x i(k + 1) respectively. The 
network is then made to learn the inverse model of plant by fitting in the data pairs 
Xi(k + 1), x(k) and u(k), and reducing the error e u (k) as shown in Figure 3.4(a). 
While using the network as controller, we provide it with desired output xu(k ) (or 
Vd{k )) and x(k) (see Figure 3.4(b)). If the network has learned the inverse model 
accurately, it will generate u(k ), which, when fed to the plant, will produce an 
output y(k + 1) that is close to desired output yd{k + 1). The existence of inverse 
model of plant is a necessary requirement for this method. 



(a) 



(b) 


Figure 3 4- Block diagram for direct inverse control method: (a) learning phase; (b) application 
phase. 

This method seems straightforward. However, certain problems are associated 
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with it. The success of this method largely depends on the ability of the network 
to generalize or learn to respond to situations that were not specifically used in the 
learning phase. This is obvious because even if we train the network for large amount 
of data sets, we cannot guarantee the inclusion of all possible situations that may 
arise in future. We may have to train the network for larger operational range than 
is required. This will need a lot of unnecessary training data and the training process 
will be time consuming. Moreover, the objective here is to minimize the network 
error || e u || 2 , but this does not guarantee the minimization of overall system error 
II x d.{k) ~ x {k) || 2 . Therefore there is no guarantee that the output trajectory will 
follow the desired trajectory accurately. It has been observed that the direct inverse 
control method generally leads to unsatisfactory results and serious questions arise 
regarding its acceptability [18], [19], [21], 

3.1.3 Direct Adaptive Control 

Direct adaptive control or specialized learning method was proposed to overcome the 
problems of direct inverse control [20]. In this approach (see Figure 3.5), the desired 
output trajectory of the plant Xi d (k) is given as input to the ANFIS controller 



Figuie 3.5. Direct adaptive control or specialized learning 


which generates u[k) that is fed to the plant. The plant then evolves into the 
next state x(k + 1). Controller parameters are trained using the error between 
actual and desired output trajectory (see Figure 3 5). Since the desired output 
for controller (say u d {k), is not known a prion we cannot apply gradient descent 
learning in its form described earlier (Chapter 2). A solution to this problem is to 
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consider the dynamic plant as an additional unmodifiable layer and propagate the 
error || X\(k) — x\ d (k) || through the plant. This requires the knowledge of plant 
derivatives or jacobian and can be achieved as shown below. 

Referring to equation (2.11), the error rate of zth node in the final layer l is given 
by 


dE p 

dO\ 


hp 


= -2 P’.p-Oy 


where 0[ p and T tiP respectively are the actual and desired outputs of ith node in 
the final layer l. Since we do not know the value of T l<p (desired control input to the 
plant) we can modify the above equation as 


dE p 

dOl 


i,p 


-2(y d (k + 1) - y(k + 1)) 


dy[k + 1) 
du(k + 1) 


(3.2) 


To use the above equation, we should have the knowledge of output sensitivity with 
respect to the control input u. If this knowledge is not available it can be estimated 
on line from the changes of plant input and output during two consecutive time 
instants 


dy{k + 1) _ y(fc + 1) - y[k) 
du(k + 1) u(k + 1) — u(k) 


Through equation (3.2) we try to minimize an oscillating error rate and this may 
cause convergence problems. To avoid this problem Saerens et al [22] have suggested 
that dy{k + 1 )/du(k + 1) be replaced by its sign and so equation (3.2) becomes 


dEp 

dO[ p 


-2{y d {k + 1) - y(k + 1)) sign 


dy{k + 1) 
du(k + 1) 


(3.4) 


The information of sign [dy(k + 1) /du(k + 1)) can be known from some prior knowl- 
edge about the plant. With the above changes, the algorithm described in Chapter 2 
can be used for training the adaptive network with direct adaptive control approach. 
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Though this method alleviates the problems posed by direct inverse control, it 
has its own limitations. Since we are training the network by error minimization for 
a particular desired trajectory, the network learns to respond in that region only 
The performance of the controller deteriorates if the desired trajectory is changed 
considerably during the application phase We are thus able to train the controller 
only in certain region of interest [20]. Moreover, if we train the network on-lme 
without any prior (off-line) training, the controlled system may become unstable [19]. 
Therefore, it is necessary to prepare the initial values of the controller parameters 
by prior off-line training m order to avoid this problem. 

3.1.4 Indirect Adaptive Control 

For applying direct adaptive control method, the knowledge of plant derivatives or 
their signs are required, and they may not be available in general. In the indirect 
adaptive control scheme [23], [24] (shown in Figure 3.6), before training the adaptive 
network controller, a separate network (known as the plant emulator) is trained 



to behave like the plant. This emulator is then used to compute the plant output 
sensitivity with respect to the controller output by propagating the error measure e 2 
through the emulator (see Figure 3.6). The emulator should be trained off-line with 
a sufficiently rich data set to allow plant identification, and then both controller and 
emulator are trained on-line m the application phase. This approach is advantageous 
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is advantageous for plants with time varying characterstics, as the emulator will be 
able to capture the system characterstics and accordingly the controller parameters 
can be tuned. 

In this case however, the quality of trained emulator is crucial to the controller’s 
performance. If the controller is operated in a range for which the emulator was not 
trained, the back propagation through emulator fails causing poor or even unstable 
control performance. 

3.1.5 Model Reference Control 

In model reference control [18], the performance of closed loop system is specified 
through a stable reference model M, which is defined by its input output pair {r(k), 
y r (k)}, where y r (k ) is the desired output of the plant. The control system attempts 
to determine the control input u(k ) so that the plant output y p (k ) matches the 
reference model output asymptotically i.e. 

lim || y p (k) - y r (k) || < e 

k — Yoo 

for some specified constant e > 0 

In this approach, indicated in Figure 3.7, the error defined above is used to train 
the adaptive network controller. 
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3.2 Preliminary Simulation Results 


In this thesis, attention was focussed on direct inverse and direct adaptive control 
methods. To observe the performance of these approaches, some preliminary sim- 
ulations were done on a linear system . The results obtained are mentioned in the 
following part. 


3.2.1 Results With Direct Inverse Control 

The linear system taken for simulations is given by: 

x = Ax + Bu, 1 
y = Cx J 

here, 
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As the system is in phase variable canonical form, it is controllable. With a sampling 
time of 10 ms, 500 samples of u(k ) were generated randomly between [-1,-f-l] and 
the values of Xi(k + 1), Xi(k), x^ (k), x$ (k) were stored. Each input was associated 
with two membership functions, giving rise to a total of sixteen rules. The initial 
MFs were formed so as to span the input space equally along the operating range 
of each input variable. The initial control action was kept zero by setting all the 
consequent parameters to zero. 

The network was then trained by fitting the above data pairs and trying to 
minimize the error between the actual control variable u(k ) and estimated value 
u(k ). While training, the initial step-size k was varied adaptively depending on the 
value of error measure. After 500 epochs of training, the error did not converge in the 
above case We tried different combinations by changing the number of rules from 
16 to 81 and to 216, also we changed the shape of initial membership functions by 
varying the premise parameters, but there was no improvement in the convergence 
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random input 


of error. One of the possible cause of this can be weak correlation between input 
u(k) and corresponding plant output y(k+ 1) as shown in Figure 3.8. We can see 
that even though the plant input is varied between [-1,4-1], there is no significant 
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Figure 3 8' (a) random input given to the linear system; (b) resulting plant trajectories 


effect on the output. The magnitude of input variation was increased to [-3, +3], 
still no considerable improvement was achieved. 

Since the plant output was not able to respond to such fast variations in the 
input signal, we changed the control input to a signal as shown in Figure 3.9. The 
number of rules chosen for this case were sixteen, and the network parameters 



Figure 3.9- Changed control input u(k) 

were initialized in the same manner as mentioned eailier. With an initial step-size 
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of 0.1, the network was trained for 50 cycles. Finally, the root mean square error 
(RMSE) between actual and desired control input was reduced to 0.0305. Desired 
and actual network outputs on training are shown in Figure 3.10(a) and desired 
and actual plant trajectories are indicated in Figure 3 10(b). It can be seen that 
although the actual control input matches closely to the desired value, there is a 



Figure 3.10- (a) control input u(k) and network output u{k); (b) desired and actual plant 
trajectories 


considerable difference between the actual and desired plant trajectories. This is 
an inherent problem of direct inverse control, which is reflected in the above results 
and can be owed to the fact that while training we are minimizing the network error 
|| u(k) - u(k) || and not the overall system error || y d (k) - y(k ) ||. 

3.2.2 Results With Direct Adaptive Control 

Same linear system, mentioned in the previous section, was used for the simulation 
studies for this case also. The controller was trained off-line to track a desired 
trajectory having 500 samples with a sampling time of 100 ms (Figure 3.11(a)). A 
network having sixteen rules (two MFs per input) was used for the above purpose. 
The initial parameters were generated in the same way as mentioned earlier and 
step-size k was taken as 0.1. Initially it was observed that the network was unable 
to train itself in the above situation. A thorough observation revealed that although 
the gradient descent part was working fine in the hybrid algorithm, the least squares 
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plant output 



(a) (b) 



(c) 


Finnic! 3 11: (a) desired and actual plant outputs while training; (b) control input u(k); (c) RMSE 
training error 

estimation (LSE) was not able to identify the consequent parameters correctly. The 
cause of this was that we were not able to provide the desired input-output data 
pairs (i.e. controller inputs and output) to the least squares algorithm. This is due 
to the fact that it is not possible,to know a priori which control input will take the 
plant output to the desired trajectory. This problem did not come in the gradient 
descent part because of the use of plant output sensitivity with respect to the control 

input u(k). 

For the solution of above problem, the LSE part was removed, and all the 
parameters in the network were updated using gradient descent. Step-size was 
reduced to 0.001, since large oscillations were observed in the plant output for 
* = 01 The results on training are shown in Figure 3.11. For testing, the desired 


39 





plant output 


output was modified and is shown in Figure 3.12(a). Step-size was increased to 0.05 
during on-line application (low value of k gave poor performance) of this trained 




(a) 


(b) 


Figure 3.12: (a) desired and actual plant outputs on testing; (b) control input u(k) 


controller. The results are shown in Figure 3.12 The results of testing with another 
trajectory are indicated in Figure 3.13. From the above we can see that the controller 



Figure 3.13: (a) desired and actual plant outputs on testing; (b) control input u(k) 


performance deteriorates if the testing trajectory is different from the one on which 
network was trained. This is a major drawback of direct adaptive control. 
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Chapter 4 

Speed Control of a Permanent 
Magnet DC Motor 


In the most common applications of a dc drive system (in rolling mills, paper mills 
etc.), the speed of the drive is required to vary along its range of operation. This 
variation is brought about by mostly controlling the armature voltage of the drive, 
which is fed through a six or twelve pulse controlled rectifier. Accurate speed 
tracking becomes an important factor for any high performance drive system. The 
direct adaptive control method, explained earlier, can be used for the above purpose 
if the desired speed trajectory is known a priori Small variations around this 
trajectory can be tracked on-line. This chapter describes the ANFIS controller 
application to a permanent magnet dc (pmdc) motor. 

4.1 PMDC Motor Model 

The pmdc motor model is indicated in Figure 4.1. The outer speed loop consists 
of ANFIS controller, which is used for speed regulation of the motor, and the inner 
current loop consists of a proportional controller to limit the motor current. Motor 
drives a quadratic load which makes the overall system nonlinear in nature. The 
system dynamics are defined by the following equations [25] 
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Figure 4.1: Block diagram of the pmdc drive system 


Load, equations: 


Tjl, — Aq + K\to + AT 2 CU 2 

(4.1) 

T m = K t I 

(4.2) 

Tm — Tl = Jto + Buj 

(4.3) 


where to is the speed of the motor, T M is the motor torque, T L is load torque, I is 
the motor current, .7 and D are motor inertia and damping constants, respectively, 
and Kr is motor torque constant. 


Electrical equations : 


E — Keu 
V — E — RI + LI 


(4.4) 

(4.5) 


where E is the motor emf, I< E is the back emf constant, L and R are the resistance 
and inductance of motor armature circuit and V is the armature voltage (control 
input). V is given by 


V = 1.35Vm,C0#cv 


(4.6) 
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where „ is Ure firing angle for a -nx-pabc rectifier bridge. The reetifier firing angle 
i., limited between 5” ami 89'. Combining equations (4 1) to (4.0) and taking 

motor speed and current a, state variables, we get the following two first order 
state equations: 


u> 


u + !&I-Ih. u 2_Kz 


'-jf- u) — j I +¥- 


(4.7) 


As mentioned earlier, the control structure of the pmdc motor system consists of 
an inner current loop which is to limit the motor armature current. A proportional 
controller is chosen for this which is of the form 


V = L35V ll C p {u-I) 


(4.8) 


where C v is the proportional gain and u is the output of speed regulator. Combining 
equations (4.7) and (4.8), we get 


u — 


-jn+Kil 


u> + 


Kfj 




Ko 

J 


I = 


_ Ul+i -WiiCA / + 


1.35Vtf,g P u 

L 


(4.9) 


which gives the reduced system shown in Figure 4.2. 


8 

ANFIS 

u(k) 

Reduced 

o)(k) 



controller 

— -O- 

Inner loop 


I(k) 


to(k+l) 




Figure 4.2: Reduced block diagram of the pmdc drive system 
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4.2 Tracking a Known Trajectory 

When the desired speed trajectory is known a priori, we can train the controller 
off-line on this trajectory and then this tuned controller can be applied in the on- 
line phase for giving desired performance. The pmdc motor system is simulated 
for tracking two different speed trajectories. A 240[V], 2[HP], 600[rpm] motor is 
selected for above purpose, whose parameter values in per unit are given in the 
Appendix. The proportional controller gain is taken as 0.80 [25]. A sampling time 
of AT = (JL0/3)ms is taken for this simulation, which corresponds to the time 
between two successive firing instants in a six-pulse rectifier. 

A network with eight rules (two MFs per input) is used, with the premise 
parameters initialized to equally span the input space. The consequent parameters 
are all sot to zero to give a zero initial control action. A step-size of 0.0001 is chosen 
for tracking a desired output shown in Figure 4.3(a). The results of the controller 
performance arc given in Figure 4.3. We can see that the system has been able to 
track the specified trajectory satisfactorily. Motor current is indicated by Figure 
4.3(b). The choice of C p = 0.8 has limited the armature current between 0.0 and 1.4 
p.u. Figure 4.3(c) shows the rectifier firing angler Spikes in firing angle indicate the 
instants at which speed was changed suddenly. The root mean square error (RMSE) 
between the desired and actual speeds is given by Figure 4.3(d). It can be seen that 
as training progresses (number of epochs increase), there is a smooth reduction in 
the RMSE. Training was discontinued after the RMSE became sufficiently constant. 
Figure 4.4 shows the initial and final (tuned) membership functions. 

The controller is also trained for a separate trajectory, Figure 4.5(a), and the 
results are indicated in Figure 4.5. The initial and final MFs are shown in Figure 
4.6. A significant observation in our simulations is that low value of step-size k 
gives a damped response, whereas for large value of k the system response becomes 

oscillatory in nature 
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Figure 4 4 Membership functions for the results of Figure 4.3: (a) initial; (b) final. 
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Chapter 5 


Disturbance Rejection in a 
Buck-Boost Converter System 


The buck-boost converter system is chosen as a second example for observing the 
performance of ANFIS controller. This system consists of a linear circuit that is 
switched between two configurations and hence the overall behaviour of the system 
becomes nonlinear. In this, the final state of one configuration becomes the initial 
state of the following configuration and vice versa, and in this way the cycle repeats. 
ANFIS controller, in the direct adaptive control mode, is applied to the exact model 
of the system for maintaining its output voltage constant when there is some random 
disturbance present in the input dc voltage. 

5.1 System Model 

The circuit for a buck-boost converter is as shown in Figure 5.1, in which the 
converter is supplied by a dc source. The output of the circuit is indicated by 
V 0 with polarity as shown in Figure 5.1. This circuit is switched periodically with 
a time period T. The switch S remains closed for a time dT and open for (1 - d)T 
in each cycle. Here, d (0 < d < 1) is called as the duty ratio of switching, which 
regulates the average output voltage (V 0 ) of the system. The relation between d and 

Vo is given by 
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Figure 5 1: Buck-boost converter: circuit details 


V. = (5.1) 

where V d is the dc input to the system. 

When the switch 5 is closed (system in mode 1), the inductor is connected to 
the input dc voltage V d , and RkC are connected in parallel (see Figure 5.2(a)). In 
this case, the input supplies energy to the inductor, and diode D is reverse biased. 



Figure 5 2: Buck-boost converter in: (a) switch on mode; (b) switch off mode. 

When the switch is open (system in mode 2), the inductor, capacitor and resistance 
are connected in parallel (diode D forward biased), and the energy stored in the 
inductor is transferred to the output (Figure 5.2(b)). The system equations in these 
two modes of operation are given by [26] 
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Mode 1 {t 0 <t< t u ti = dT) : 

x ~ Aix + 


( 5 . 2 ) 


Mode 2 (ti<t< t 2 , t 2 = (1 - d)T) : 


x — A 2 x + B 2 V d 


( 5 . 3 ) 


and the output is given by 


y = Cx = V 0 


( 5 . 4 ) 


Defining a state vector x = [vc the matrices in equations (5.2) - (5.4) are given 
by . 


' -1/AC 0 ' 

; A 2 = 

' -1 IRC 

l/C~ 

0 0 



0 


B ! 




[l 0] 


5.2 Disturbance Rejection Using ANFIS 


ANFIS controller was applied to the buck-boost converter model mentioned above, 
for keeping its output average voltage constant when some random disturbance 
(noise) was present in the input dc voltage. For this purpose, the following values 
were chosen as the system parameters 

L = 4 mH; C = 25^ F; R = lOfi; V d = 100 V 


51 


feu. /fo. * 123320 



These values gave positive inductor current even for a duty ratio of 0.05, and 
hence the system operated only m continuous mode of conduction. The switching 
frequency of the circuit was chosen to be 1500 Hz. A block diagram of the converter 
system along with controller is shown in Figure 5.3. The dc voltage V d (containing 



Figure 5.3 Block diagram of a buck-boost converter control system 


noise), and state variables, capacitor voltage and inductor current, were given as 
inputs to the network. The corresponding controller output (Ad), was fed to the 
plant, in addition to a fixed value of d 0 = 0.3 The objective of the combined system 
is to maintain a constant output voltage corresponding to this value of d 0 and is 
given by 

v - = ih v ‘ = i^ 100 = 42W 

The nominal states for d D = 0 3 are given by 

£ 0 = [43.46 2.87] r 

A network with eight rules (two MFs per input) was formed and its parameters 
initialized. Sampling time of AT = 1/150000 was taken for simulating this system. 
The step-size was fixed to 0.0001. The input voltage V d was generated by adding a 
random disturbance between [-10, +10] V to a value of 100 V. Also, for some time the 
input was kept noise free (see Figure 5.4(a)). The results of the simulation are shown 
in Figure 5.4 and initial and final membership functions are shown in Figure 5.5. We 
can see that when the disturbance is present in the input voltage V d , the controller 
output Ad varies to change the switching instant in a cycle, and hence controls the 
average output voltage. On removing the disturbance, Ad becomes constant, to 


52 





control input ( Ad ) 



Figure 5.4: Simulation results for a network with three inputs and eight rules: (a) input dc voltage 
V d ; (b) desired and actual output voltages; (c) control input A d; (d) capacitor voltage and inductor 

current. 


give constant average output voltage. However, small oscillations are visible in the 
value of A d and can be owed to the fact that the feedback to the controller consists 
of capacitor voltage and inductor current, which contain ripples. On removing this 
feedback, and using four rules, A d became perfectly constant (Figure 5.6). The 
average output voltage is shown in Figure 5.6(b). It shows that although the system 
has not been able to eliminate the noise completely, its magnitude is reduced to 
[-1.5, +1.5]. Figure 5 7 shows the initial and final membership functions. 
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Chapter 6 
Conclusions 


In this thesis, an attempt has been made to evaluate the performance of a class 
ol neuro-luzzy controllers. Such controllers come info picture when the classical 
control techniques fail in generating a satisfactory solution, which is generally the 
case for nonlinear/ ill-defined systems. The neuro-fuzzy system used here is formed 
by converting the Sugeno fuzzy model into an adaptive network and tuning its 
parameters using gradient descent or hybrid learning algorithm discussed earlier. 
Some of the conclusions and scope for future work is given in this Chapter. 

6.1 General Conclusions 

In the present work, we have focussed our attention on two control structures: direct 
inverse control and direct adaptive control. These can be derived using ANFIS. 
Preliminary simulations were done on a simple linear system using these structures 
and some important points were observed. The direct inverse control scheme, when 
applied on the specified system, was found to be unsuitable for tracking the desired 
plant output. Different combinations were tried on this method by changing the 
number of MFs per input (number of rules), number of training data samples, 
stepsize and initial parameters. Once a minimum number of rules were defined, we 
did not obtain any significant improvement on the RMSE on increasing the number 
of rules. On the contrary, because of increased number of rules, the network became 
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more complex and training time is increased. After a minimum number of samples 
in the dataset (> number of modifiable parameters) were available an increase in 
the training data did not alter the performance of the network. The initial step-size 
was mostly kept around 0.10. In between it was varied to check whether the network 
was getting trapped into a local minima while training. Furthermore, since we were 
adaptively updating the stepsize, the initial value is not very critical as long as it is 
not too big. 

Usually bell shaped initial membership functions were used. Their shapes were 
varied to see the convergence property of the network. This did not have any 
substantial effect on the network performance. Even after applying the above 
changes, no significant improvement was observed in our simulation results. The 
unsatisfactory performance of direct, inverse control scheme has also been reported 
in the literature [18], [19], [21]. 

Direct adaptive control method was then applied to alleviate the above problems. 
On the basis of its performance on specified linear system and two other nonlinear 
control problems (speed control of pmdc motor system and disturbance rejection in a 
buck-boost converter ), the following points were observed. This method performed 
well when the desired trajectory to be tracked was known a priori. Although the 
system was able to track some small variations around the tiajectoiy on which 
training was done, but its performance deteriorated when the desired output was 
changed considerably in the application phase. Better performance in this respect is 
reported in the literature using variable gain control approach [25]. It can tlieiefoie 
be concluded that practical applications of this technique will be limited, as every 
time the the desired trajectory changes, controller will have to be re-tuned. Also, 
for each training cycle (epoch) we will have to operate the plant, which may be 
costly and time consuming. The stability performance of those systems is also a 
cause for concern. Though current research is going on in this area, very few results 

are available at present [28]. 

Training forms a very important part in the performance of the adaptive network. 
This area is primarily guided by heuristics and formal training proceduies, such that 
the network captures the desired controller dynamics sufficiently well are currently 
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not available. Furthermore, results regarding the network size, number of rules 
etc. for optimum network performance are not present. A firm theoretical basis is 
required in this regard. 

The control techniques discussed in this work did not give the desired per- 
formance level for their application to problems of practical importance. Certain 
control techniques based purely on fuzzy methodologies have been more successful 
than ANFIS. The reasons for this can be attributed to the lack of firm theoretical 
framework in the field of fuzzy-neural systems. However, since this field is still in a 
fluid state and a lot of research is in progress in both, the theoretical and application 
domain, better results can be expected in the near future. 

6.2 Scope for Further Work 

Although, various factors were considered while applying ANFIS controller in the 
above work, there are still some important areas which can form the subject of 
further investigation. In our simulations, network training was started from a point 
where it has no prior knowledge about the system. Faster convergence and better 
generalization may be achieved if some initial knowledge can be incorporated into 
the network in the form of initial parameters and number of rules etc. In direct 
adaptive control, this can form the part of off-line learning, while during on-line 
application the network can refine these parameters to give better generalization. 

In this thesis, while applying the gradient descent algorithm, we have calculated 
the error rates based on error measure E p . This can be changed to a suitable 
objective function to realize different control goals. Models other than the Sugeno 
fuzzy model can be investigated. Even though this model captures a piecewise linear 
system more accurately, there is still scope for models which capture the nonlinear 
dynamics better. A general purpose model, which can describe various types of 
nonlinearities, will be a very important development. 
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Appendix 


The parameters for the pmdc motor chosen for simulation studies in Chapter 4 are 
given below. The parameters are scaled by their base values. 

Rated power = 2 [HP]; Rated voltage = 240 [V]; 

Rated speed = 600 [rpm]; Resistance R = 0.1684 [pu]; 

Inductance L = 0.0814 [pu]; Moment of inertia J = 0.1985 [pu]; 

Damping B = 0.079 [pu], Torque constant Kt = 1 [pu]; 

Back emf constant Ke = 1 [pu]; Load constant K 0 = 0.1895 [pu]; 

Load constant K\ = 0 [pu]; Load constant K% = 0.8313 [pu]. 
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